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(57) Abstract 

A telecommunications videoconferencing facilty represents other users on a user's display service (21) by means of graphical 
representations (avatars) (2, 3, 4) corresponding to the respective users. The virtual environment can be arranged differently for each 
user, e.g., the relative positions of the avatars and other elements (e.g., whiteboard faciliity (32)) of the environment can be different for 
ease of viewing. The avatars carry out symbolic actions, relating to the various events taking place during the virtual telecommunications 
conferencing process, under the control of simple commands which cause their avatars to move in complex ways, without the need for the 
user to perform a complex navigational task around the virtual environment. For example, a user (2) whishing to use the whiteboard facility 
(32) can access it using a "mouse" or keyboard operation, which will cause the avatar representing the user (2) to move to the whiteboard 
(32) in the virtual environments of the other users (1,3, 4). The act of copying a document (33) may be represented by the movement of 
a representation (33a) of such a copy across the table (31). 
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CONFERENCE FACILITY 



This invention relates to teleconferencing, and in particular a facility for 
the generation of images relating to a "virtual meeting space", within the context 
5 of which individuals at a plurality of locations remote from each other may interact 
in a manner which emulates a conventional meeting. 

A number of systems are being developed which define a virtual Cartesian 
space in which the individual members of a teleconference are positioned, and 
each individual's view of the meeting space as shown on their display is 
10 determined by the individual user's position within the Cartesian space. Examples 
are to be found in United States Patent 5,491,743 granted to Shiio et al (assigned 
to IBM), and European Patent Application no 0 516 371, in the name of Fujitsu. 
Facilities may be provided in such systems to allow documents to be created, 
retrieved, etc. For example, one wall of the "meeting space" may be represented 
15 as a drawing board on which images can be represented. The user wishing to use 
the drawing board carries out a control function which causes the system to 
change the relative positions of the user and the whiteboard in the virtual space 
such that the user can generate images on it. 

Individual users are represented in the virtual space display by computer- 
20 generated representations of the users, known as "avatars" (or "icons"). These 
may be derived from video images of the users, either live or retrieved from a 
store, but usually they are digitally generated representations. In general, each 
user is able to select the appearance of his or her avatar in the virtual space from a 
menu of characteristics. Alternatively, each individual user may be able to select, 
25 for his own viewpoint, how each of the other users' avatars will appear. Other 
characteristics of the meeting space, such as the colour and shape of the elements 
of the meeting space, may also be selectable by the user. 

There are a number of disadvantages to the conventional virtual meeting 
spaces. In the system discussed in the Shiio patent already mentioned, an 
.30 overview of a conference room is represented. Each user sees the same view, 
including his or her own avatar in whatever position it has been placed. In this 
arrangement the user does not have the feeling of being in a room with the other 
participants, but is merely watching his or her avatar's activities, from a vantage 
point outside the room. It is possible to arrange for each user to see only the 
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avatars of the other users, and not his own, from a viewpoint such that the 
relative positions of each avatar to each other avatar and to the user's viewpoint is 
consistent between users. For example, with reference to Figure 2 of the drawings 
attached to this specification, if a user "3" is shown a representation of the 
5 meeting space in which the avatar of user "1" is facing him, with avatars of users 
"2" and "4" facing each other at 90° to the viewpoint of user "3", then the user 
"4" would see the avatar of user "2" facing him, and the avatars of users "1" and 
"3" facing each other at 90° to his viewpoint. This gives a more realistic 
representation of a real conference room, but the relative positions of the users 
0 make it difficult to view all the users and other elements of the conference facility 
at the same time on a conventional video monitor. 

In the Fujitsu reference mentioned previously, the avatars of the other 
users are arranged around the user's virtual viewpoint, as if on a turntable, which 
can be rotated to bring a selected avatar into view. The user represented by that 
5 avatar will not necessarily be looking at the first user's avatar. Thus eye contact is 
not necessarily two-way, and participants will not interact as they would in a real 
space as two avatars which appear adjacent to one user will not necessarily 
appear so to another user. 

Furthermore, events taking place in the meeting space, such as an 
0 individual operating the "whiteboard", or joining or leaving the meeting, require 
complex navigation around the virtual space in order to be reasonably realistic. In 
both systems, such navigation requires considerable thought on the part of the 
user, to ensure that unrealistic occurrences, such as one user walking through 
another, or through the furniture, do not take place. Such distractions can disrupt 
5 the conduct of the conference itself. Furthermore, if a drawing facility is provided, 
it can only occupy a portion of the view, making it difficult to use. 

According to the invention, there is provided a method of representing 
users on a display device in a telecommunications conferencing facility by means 
of graphical representations corresponding to the respective users, wherein the 
D users are depicted as carrying out symbolic actions, relating to the various events 
taking place during the virtual telecommunications conferencing process, the users 
and their activities being represented to each user by means of graphical 
representations, and characterised in that symbolic positions and movements of 
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the representations of each user are selected according to the viewpoint of each 
user. 

6 According to a second aspect, the is provided a telecommunications 

conferencing system comprising display control means for representing users on 
5 display devices by means of graphical representations corresponding to the 
respective users, the display control means being arranged to depict symbolic 
actions carried out by users, relating to the various events taking place during the 
virtual telecommunications conferencing process, and for presenting, to each user, 
a representation of the other users and their activities; 
10 characterised in that the display control means is arranged to represent the 
presence and activities of each user to each other user by means of symbolic 
positions and movements, selected according to the viewpoint of the user to 

whom the view is presented. 

This invention allows the realistic representation of a meeting by providing 
15 a "meeting space" which is consistent from the viewpoint of each user, without 
necessarily being consistent between users. 

The more inconvenient aspects of a real meeting space can be eliminated, 
rather than emulated. For example, the accessing of a facility by one user for 
viewing by other users can be represented in a different manner for the viewing 
20 users and the accessing user, and users not currently actively engaged in the 
telecommunications conference can be represented in a different manner from 
those currently viewing the conference. 

Activities such as providing copies of documents may be represented 
symbolically, and social cues may also be represented, in response to specific 
25 commands from the individual users. 

Each user's representation of the meeting space may be arranged such 
that all other elements of the meeting space, including the other users, appear 
within a narrow and preferably fixed field of view, corresponding to his own 
display device's dimensions. For example, a user with a wide-screen panoramic 
30 display device may depict the other users spaced further apart than would a user 
with a much smaller screen, for example on a lap-top computer. 

This improves the ease of use of the system by each user in the meeting 
space, as changes of viewpoint are not necessary. It allows all users to see each 
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other without changing viewpoint, which is not possible even in a real meeting 
space. 

The operation of the invention can take place by interaction between a 
central "server", and a plurality of client devices. The central server controls those 
5 aspects of the system common to all users, such as information relating to the 
activities to be depicted, and the client devices are responsible for those aspects 
specific to each user, such as actions taken by the respective user, information on 
which is transmitted to the server for depiction on the other user terminals. 

The invention will now be discussed in greater detail with reference to the 
1 0 drawings. 

Figure 1 represents the general configuration of a system arranged to 
operate the present invention, 

Figure 2 is a representation of a virtual meeting space according to the 

prior art, 

1 5 Figure 3 and 4 are a representations of a virtual meeting space according 

to the invention, 

Figures 5 to 1 2 are various representations of the virtual meeting space as 
seen by different individual users in different circumstances as will be described. 

In Figure 1 there is shown an arrangement to allow four users 1 , 2, 3, 4 to 

20 interact in a virtual teleconference. Each user has a respective human/machine 
interface unit 21, 22. 23, 24, which includes all the necessary video and audio 
equipment for the user to see and hear what is happening in the virtual meeting 
space, and the necessary user input devices (e.g. keyboards, computer "mouse" 
etc.) to provide input to the virtual meeting space. Each interface, 21, 22, 23, 24 

25 is connected to a respective client apparatus 11. 12, 13, 14 which provides an 
interface between the user and a main server 10 which controls the operation of 
the meeting space. The server 10 has. as a further input, a store 30 which 
maintains permanent data defining the virtual meeting space. The control of the 
meeting space is carried out by interaction between the client apparatuses 11,12, 

30 13, 14 and the server 10. In some embodiments most of the display control 
functions may take place in the server 10, but in systems where the display 
apparatuses 21. 22, 23, 24 are dissimilar, more of the display control functions 
may be different for each apparatus, therefore requiring more of the display control 
functions to be distributed in the client apparatus 11, 12, 13, 14. 
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In response to inputs from one of the users (e.g. user 1) through his 
respective user interface (21) the client apparatus transmits these inputs to the 
main server 10 which, in accordance with the meeting space definition 30, 
controls the images to be represented on the other users screen 22, 23, 24 to 
represent the activities of the user 1, input through interface device 21. As a very 
simple example, the actions of the user 1 when first establishing contact with the 
meeting space are translated by the client computer 1 1 and converted by the 
server 10, into a representation of the user 1 entering the meeting space, which is 
in turn passed to the individual clients 12, 13. 14 to be represented as the avatar 
of the user 1 moving into the field of view of the display devices 22, 23. 24. 

The manner of representation of the individual user 1 in the virtual space 
may be selected either by the user 1 through his respective client device 1 1, or by 
each receiving user 2, 3, 4 in the meeting space, who may each select an avatar 
according to his own requirements to represent the user 1. Similarly, some parts 
of the virtual meeting space may be defined centrally in the meeting space 
definition unit 30, whereas other aspects may be defined by each individual client 
11. 12. 13, 14 independently of the others. Such definitions may include colour 
schemes, the relative locations of the individual users 1 , 2, 3, 4, etc. 

In Figure 2 is shown a representation of a prior art virtual meeting space. 
) It will be noted that the virtual meeting space shows four users 1,2,3. 4, located 
at equally spaced intervals around a table 31. It will be noted that in order for any 
user (e.g. user 3) to clearly see all the other users (1, 2. 3, 4), a fairly wide angle 
of view is required. In order to view different users the direction of view must be 
changed, and it is difficult to view all members of the virtual conference 
5 simultaneously. This problem obviously increases, the more people are taking part 
in the conference. Furthermore, if there are items such as a representation of a 
"whiteboard" in the meeting space, it cannot be visible to all participants at once, 
as if it is facing user "1", for example, the avatar of user "3" will be facing away 
from it. It will therefore not appear in his field of view. 
JO Figure 3 shows a virtual meeting space in the system according to the 

invention as seen by a user 3. It will be noted that for the user 3 the three 
remaining users 1, 2, 4 now subtend a much narrower angle. 

Figure 4 shows the same virtual meeting space, but seen from the 
viewpoint of a different user 4. It will be seen that the other users 1,2,3 also 
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subtend a narrow angle as seen from the user 4, in the same way that in Figure 3 
the users 1 , 2, 4 subtend a narrow angle as seen from the user 3. The server 10 
and clients 11, 12, 13, 14 are arranged to represent the relative positions of the 
avatars according to this distorted co-ordinate system, such that for each user the 
5 other users subtend a relatively narrow angle and may all appear within the same 
field of view. It will be noted that although the angular distance between the 
users is different from each viewpoint, the order in which they appear around the 
table is preserved. This allows sociological cues, such as interactions between 
neighbours around a table, to occur consistently regardless of the viewpoint. 
0 Figures 5 to 12 show various representations of the virtual meeting space, 

as viewed by different individual users 1, 2, 3, 4, in different circumstances. The 
avatars representing each user are indicated by reference numerals 1, 2, 3 and 4. 
For clarity in this description, the avatars for each user has a respective shape, 
which is consistent between viewpoints, but as has been discussed, each user 
5 may choose to represent a particular participant in a different way in his own 
viewpoint. The viewpoint represented in each figure is indicated by the reference 
numeral relating to the user terminal on which the view is being represented. 
Therefore, Figures 5, 7. 8 and 9 show the view as seen on user terminal 21, 
belonging to user 1; Figure 6 and 1 2 show the view on terminal 24, belonging to 
0 user 4, and Figures 10 and 1 1 represent terminals 22 and 23 respectively, in use 
by users 2 and 3 respectively. Common to all the virtual meeting space images 
are the avatars of the other users 1, 2, 3, 4, a table 31 and a "whiteboard" 32. 
Other elements will be described with reference to the figures in which they are 
represented. It should be noted that for each user, all other users and elements 
5 of the meeting space are in full view, without any need to change viewpoint. This 
is so, despite some elements appearing, to one user, to be behind another user. 

Figure 5 shows schematically the view of the virtual meeting space as 
seen by one of the participants 1. Users 2 and 4 are also taking part in the 
teleconference; this can be seen by the full representation of the avatars 2 and 4 
in their respective positions around the table 31. User 3, although allocated a 
position in the virtual meeting space has not yet entered the meeting space, and 
his avatar is replaced by a representation of an empty seat 3. Users 2, 3, and 4 are 
represented as subtending an angle of approximately 90°, with the avatars of 
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users 2 and 4 each at approximately 135° from the angular position around the 

table 31 of the viewing user 1. 

Figure 6 shows the same situation as viewed by another user 4. It will be 
seen that the view is the same as that in Figure 5, except that user 1 is 
5 represented instead of the user 4. Note that the relative positions around the table 
are preserved i.e. user 3 is still to the left of user 2, but the angular distance 
between users is not the same as in Figure 5. In the meeting space as viewed by 
the user 4. users 1 and 2 are separated by only approximately 45°, with the users 
1 and 3 at approximately 135° angular position from the viewing user 4. 
10 Figure 7 represents the view of the meeting space as viewed by the user 

1, in the situation where two of the users 2. 3 are conducting a conversation 
between themselves, using a separate connection. The avatars of the users 2 and 
3 are shown as facing each other and closer together than in other views, 
indicating that they are not currently primarily concentrating on the meeting space. 
15 The facility for private discussion (conferring) may be provided in virtual meeting 
spaces in order to allow discussion between two parties, for example to agree a 
negotiating position before presenting it to the meeting at large. 

A user may indicate that he wishes to close the conference in the near 
future, or to withdraw from it, by entering a command to the server. The server 
20 responds by causing the avatar of that user to perform an action representative of 
activities performed by real people in such a situation. 

Such actions may include putting papers into a case, looking at a clock (if one is 
present in the virtual meeting space) or at a wristwatch, as shown in Figure 7 (user 
4), or putting a coat on. Different actions may be represented each time the user 
25 activates the command, to indicate increasing proximity to the closure time. The 
user may pre-programme such cues to appear at predetermined times leading up to 

the desired closure time. 

Figure 8 is a representation in which the user 2, although still connected 
to the meeting space, is consulting a document. This can be done by the user 2 
30 by calling up the relevant document on his computer screen (for example by 
'clicking' with a 'mouse'), the meeting space typically being relegated to a small 
representation of the meeting space in one corner of the viewpoint of the screen. 
The system shows the avatar of the user looking at a representation 33 of a 
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document on the table 31, to represent to the other users, e.g. user 1, the fact 
that the user is primarily studying something other than the meeting space. 

Another user 1 may obtain a copy of a document by performing an action 
on it (e.g. 'clicking' a mouse cursor). Subject to the document not being copy- 
5 protected, (which may be indicated by some characteristic of the representation of 
the document, e.g. its colour), the user 1 can then obtain a copy of the document. 
Alternatively the user 2 who holds the document may perform some action to copy 
the document to one, some, or all of the other participants. A representation 33a 
of the copy will be shown in the user space as moving from the user 2 to the other 
10 user or users. 

Figures 9, 10, 1 1 and 12 represent the viewpoints of the individual users 
1, 2, 3 and 4 when a user (user 1 for example) wishes to use the "whiteboard" 
facility of the virtual meeting space. In order to access this facility the user 1 may 
carry out predetermined input in the user interface unit 21 in order to indicate that 

15 he wishes to use the whiteboard. For example, he may use a "mouse" to "click" 
on the whiteboard space 32 represented in viewpoint 21. This will cause the 
screen representation 21 to change to a full screen view of the whiteboard 32 as 
shown in Figure 9. A cursor 35 is present to allow the user to draw a diagram 34 
etc. on the whiteboard 32. The view of the meeting space is relegated to an inset 

20 21a. 

From the points of view of the other users 2, 3 and 4, the avatar of the 
user 1 is represented as moving from his respective position around the table 31 
(which is of course different for each user) towards the representation 32 of the 
whiteboard (whose position relative to the avatar of user 1 is also different in each 
25 viewpoint). The movement of the avatar 1 to the whiteboard 32 is therefore 
different in each case, because of the different viewpoints. Furthermore, the user 
1 is not required to 'navigate' around (or through) the virtual table 31 to reach the 
whiteboard 32. 

It will be noted that in each viewpoint the whiteboard 32 appears in the 
30 field of view. However, each user sees the whiteboard 32 positioned behind a 
different other user. For example, in Figure 5 it will be seen that from the 
viewpoint of user 1 the whiteboard 32 is behind the avatar of user 4. In Figure 6, 
the whiteboard 32 seen by the user 4 is behind the avatar of user 3. Thus, unlike 
in a conventional virtual meeting space (or indeed a real meeting space), no user 
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perceives the whiteboard as being behind himself: each user perceives the 
whiteboard as behind someone else. Thus each user will find the whiteboard is 

within his field of view. 

Movements, positions, and other attributes of the individual users are thus 
represented symbolically in the virtual meeting spaces. Each user will see the 
other users' avatars behaving in an appropriate way for activities taking place 
during the meeting, although the users will have a different view as to the deta,. of 
such activities, e.g. the distance that another user has to move in order to access 
an element, the relative distances between avatars, and even the appearances of 
the individual avatars and the fixed parts of the meeting space. 
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CLAIMS 

1. 



A method of representing users (1, 2, 3, 4) on a display device 
(21,22,23,24) in a telecommunications conferencing facility by means of graphical 
5 representations corresponding to the respective users, wherein the users (1,2,3,4) 
are depicted as carrying out symbolic actions, relating to the various events taking 
place during the virtual telecommunications conferencing process, the users 
(1,2,3.4) and their activities being represented to each user (1,2,3,4) by means of 
graphical representations, and characterised in that symbolic positions and 
10 movements of the representations of each user (1,2,3.4) are selected according to 
the viewpoint of each user (1,2.3,4). 

2. A method according to claim 1, wherein for each user (1), the 
representations of each of the other users (2,3,4) are arranged such that they are 

15 all contained within the field of view of the user's display device (21). 

3. A method according to claim 2, in which the symbolic actions are selected 
such that they take place within a fixed field of view. 

20 4. A method according to claim 1, 2 or 3, wherein the accessing of a facility 
by one user (1) for viewing by other users (2,3,4) is represented in a different 
manner for the viewing users (2,3,4) and the accessing user (1). 

5. A method according to one of claims 1 to 4. wherein users (3) not 

25 currently actively engaged in the telecommunications conference are represented 
in a different manner from those currently viewing the conference (2,4). 

7. Telecommunications conferencing system comprising display control means 
(10, 11,12,13,14) for representing users on display devices (21, 22, 23, 24) by 
30 means of graphical representations corresponding to the respective users (1.2,3,4), 
the display control means being arranged to depict symbolic actions carried out by 
users, relating to the various events taking place during the virtual 
telecommunications conferencing process, and for presenting, to each user, a 
representation of the other users and their activities; 
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characterised in that the display control means (10. 1 1, 12, 13, 14) is arranged to 
represent the presence and activities of each user to each other user by means of 
symbolic positions and movements, selected according to the viewpoint of the 
user to whom the view is presented. 

7. Conferencing system according to claim 6, wherein the display control 
means is arranged to represent, for each user (1), each of the other users (2 ,3, 4) 
such that they are all subtended within the field of view of the display device (21) 
of that user (1). 

8. Conferencing system according to claim 7. in which the symbolic actions 
are selected such that they take place within a fixed field of view. 

9. Conferencing system according to any of claims 6 to 8 comprising means 
15 for accessing a facility by one user (1) for viewing by other users (2 ,3, 4) wherein 

the accessed facility is represented in a different manner for the viewing users and 
the accessing user. 

10. Conferencing system according to any of claims 6 to 9, wherein the 
20 display control means (10, 11, 13, 14) is arranged to represent users (3) not 

currently actively engaged in the telecommunications conference in a different 
manner from those (2 ,4) currently viewing the conference. 



11. System according to any of claims 6 to 10, comprising client means (11, 
25 12, 13, 14) associated with each user (1, 2. 3, 4) for generating at least part of 
the user's viewpoint. 



System according to any of claims 6 to 1 1 , comprising server means (10) 
accessible by each user (1, 2, 3, 4) for generating at least part of the users' 
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